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CERTIFICATE OF I 

I hereby certiftwthat this < 
Postal Service with syficient 
Commissioner foj^ferents, P.< 
2004. 



ILING UNDER 37 C.F.R. § 1.8 

pondence is being deposited in the United States 
first class mail in an envelope addressed to 
&50, Alexandria, VA 22313-1450 on January 20, 



_( Attorney Signature) 



Larry T. Harris, Keg. No. ff,145 
Signature Date: January Ivf, 2004 



INFORMATION DISCLOSURE STATEMENT UNDER 37 C.F.R. S1.56 

Commissioner for Patents 

P.O. Box 1450 

Alexandria, VA 22313-1450 

Sir: 

It is requested that the information identified in this statement be considered by the Examiner 
and made of record in the above-identified application. This statement is not intended to represent that 
a search has been made or that the information cited in the statement is, or is considered to be, material 
to patentability as defined in 37 C.F.R. § 1 .56. If this is a continuation, divisional or continuation-in-part 
application, it is understood that the Examiner will consider all information which was considered by the^ 
Office in a parent application. MPEP §609. Such information therefore is not listed herein unless it is 
desired that the information be printed on a patent issuing from the subject application. 

Enclosed with this statement are the following: 

✓ Form PTO-1449. The Examiner is requested to initial the form and return it to the undersigned 
in accordance with M.P.E.P. §609. 

y The present application was filed after June 30, 2003 . In accordance with the pre-official gazette 
waiver of 37 CFR 1 .98 (a)(2)(i) posted at: pac/dapp/opla/preognotice/idswouscopies.htm , copies 
of cited U.S. patents and publications are not enclosed. However, copies of cited foreign patent 
documents and non-patent literature are enclosed in accordance with 37 CFR 1 .98(a)(2), as still 
required, except for those items designated by an asterisk (*), which were previously submitted 
by the applicant in a parent application, from which benefit under 35 U.S.C. §120 is claimed, 
with an Information Disclosure Statement submitted in the parent application which complies 
with the September 8, 2000 or subsequent revision of 37 C.F.R. § 1 .98(a-c), as allowed under 37 
C.F.R. § 1.98(d)(1). 
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✓ If any of the cited/submitted documents is in a foreign language, a concise explanation of 
relevance is provided pursuant to 37 C.F.R. § 1 .98(a)(3)(i). For foreign language documents cited 
in a search report by a foreign patent office, the requirement for a concise explanation of 
relevance is satisfied by the submission herewith of an English language version of the search 
report. MPEP §609A(3). If a written English-language translation of a non-English language 
document, or portion thereof, is within the possession, custody or control of, or is readily 
available to any individual designated in § 1.56(c), a copy of the translation accompanies this 
statement, 37 C.F.R. §1.98(a)(3)(ii), and satisfies the requirement for a concise explanation of 
relevance, MPEP §609A(3). 

PTA Statement under 37 C.F.R. §1. 704(d). Each item of information contained in the 

Information Disclosure Statement was cited in a communication from a foreign patent office in 
a counterpart application and this communication was not received by any individual designated 
in §1.5 6(c) more than thirty days prior to the filing of the Information Disclosure Statement. 

This statement should be considered because: 

S 37 C.F.R. §1.97(b). This statement qualifies under 37 C.F.R. §1.97, subsection (b) 
because: 

(1) It is being filed within three months of the filing date of an application other 
than a continued prosecution application under § 1.53(d); 

--OR-- 

(2) It is being filed within 3 months of entry of a national stage; 

-OR- 

(3) It is being filed before the mailing date of the first Office Action on the merits, 

- OR - 

(4) It is being filed before the mailing date of the first Office Action after the filing 
of a Request for Continued Examination under 37 C.F.R. §1.1 14. 

37 C.F.R. §1.97(c). Although it may not qualify under subsection (b), this statement 

qualifies under 37 C.F.R. §1.97, subsection (c) because: 

(1) It is being filed before the mailing date of a FINAL Office Action, a Notice of 
Allowance, or an action that otherwise closes prosecution in the subject 
application, whichever occurs first. 

- AND (check at least one of the following) — 

_ (1) It is accompanied by a STATEMENT as set forth in 37 C.F.R. § 1.97(e). 

- OR - 

(2) It is accompanied by the $ 1 80 fee set forth in 37 C.F.R. §1.1 7(p). 

37 C.F.R. §1.97(d). Although it may not qualify under subsection (b) or (c), this 

statement qualifies under 37 C.F.R. §1.97, subsection (d) because: 

(1) It is being filed on or before payment of the Issue Fee; 

--AND-- 

(2) It is accompanied by a STATEMENT as set forth in 37 C.F.R. § 1 .97(e); 

- AND-- 

(3) It is accompanied by the $180 fee set forth in 37 C.F.R. §1.17(p). 
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y Fee Authorization. The Commissioner is hereby authorized to charge any deficiencies or credit 
any overpayment to Deposit Account No. 06-1325. A duplicate copy^f this authorization is 
enclosed. 



Date: 01 



Respectfully s, 



Larry T. Harris 
Reg. No. 44,7 




FLIESLER MEYER LLP 
Four Embarcadero Center, Fourth Floor 
San Francisco, California 941 1 1-4156 
Telephone (415) 362-3800 
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s vForm PTO-1439 U S DEPARTMENT OF COMMERCE 
(Sui^Ue) PATENT AND TRADEMARK OFFICE 

Information Disclosure Statement 

BY APPLICANT 

(Use several sheets if necessary) 


Attorney Docket Number 

FX/A2022 


Serial/Patent Number 

10/612,428 


Applicant/Patent Owner 

Girgensohn, et al. 


Filing/Issue Date 

July 2, 2003 


Group Art Unit 

2615 



U.S. PATENTS 



Examiner 
Initial 



Patent Number 



Issue Date 



First Named Inventor 



Class 



Subclass 



Filing 
Date 



U.S. PATENT PUBLICATIONS 



Examiner 
Initial 



Patent Application Publication Number 



Publication Date 



Applicant 



US 2003/0189588 Al 



October 9, 2003 



Andreas Girgensohn 



US 2003/0190143 Al 



October 9, 2003 | Andreas Girgensohn 



PENDING U.S. PATENT APPLICATIONS 



Examiner 
Initial 



Application Number 



Filing Date 



First Named Inventor 



Petition to 
Expunge? 
Yes | No 



09/618,649 



July 18, 2000 



Andreas Girgensohn 



09/618,533 



July 18,2000 



Andreas Girgensohn 



FOREIGN PATENT DOCUMENTS 



Examiner 
Initial 



Document Number 



Publication 
Date 



Country 



Class 



Subclass 



Trans- 
lation 



Yes No 



OTHER DOCUMENTS (Include author (if any), title, publisher and place of publication, date and pertinent pages) 



5. 



Avrahami, G., Brooks, K.P., and Brown, M.H. "A Two-View Approach to Constructing User Interfaces," 
A CM SIGGRAPH 6 89, Boston, 31 July - 4 August, 1989. 



6. 



Boreczky, J. and Wilcox, L., "A Hidden Markov Model Framework for Video Segmentation Using Audio 
and Image Features," in Proc ICASSP '98, IEEE, May 1998, Seattle. 



Boreczky, J. and Rowe, L., "Comparison of Video Shot Boundary Detection Techniques," Proa SPIE 
Storage and Retrieval for Image and Video Databases IV, San Jose, CA, 1996. 



Christel, M., Smith, M., Taylor, C, and Winkler, D., "Evolving Video Skims into Useful Multimedia 
Abstractions," in Human Factors in Computing Systems, ACM CHI '98 Conference Proceedings, 
pp. 171-178, Los Angeles, April 1998. 



Girgensohn, A. and Boreczky, J. "Time-Constrained Keyframe Selection Technique," in IEEE Multimedia 
Systems '99, IEEE Computer Society, Vol. 1, pp. 756-761, 1999. 



10. 



He, L., Sanocki, E., Gupta, A., and Grudin, J., "Auto-Summarization of Audio-Video Presentations," ACM 
Multimedia, April 1999. 



11. | Knuth, P., The T^XbooK Addison- Wesley, 1984. 
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"^-^^"^OTHER DOCUMENTS (Include author (if any), title, publisher and place of publication, date and pertinent pages) 




1 0 


PfV*i"fff»r SI T ienharf R Pi^rhpr Q s»nH PfffO ch^ro - \A/ u A Vic trap finer T"jicrit"j*1 A/Ip»vip<; Antomatirallv " in 

Journal of Visual Communication and Image Representation, Vol. 7, No. 4, pp. 345-353, December 1996. 




13. 


Smith, M. and Kanade, T., "Video Skimming and Characterization through the Combination of Image and 
Language Understanding Techniques," in Proc. Computer Vision and Pattern Recognition, pp. 775-781, 
1997. 




14. 


Uchihashi, S. and Foote, J., "Summarizing Video Using a Shot Importance Measure and a Frame-Packing 
Algorithm," in Proc. ICASSP '99, Vol. 6, pp. 3041-3044, 1999. 




15. 


Webster, B.F. The NeXT Book, Addison-Wesley, 1989. 




17. 


Gross, G., "Molecular Mechanics Optimisation," 

http://www.chem.swin.edu.au/modules/mod6/molmech l.htrnl, October 9, 2000. 




18. 


Cooper, M. and Foote, J., "Summarizing Video using Non-Negative Similarity Matrix Factorization," 2002 
IEEE. 




19. 


Girgensohn, A., Boreczky, J., Chiu, P., Doherty, J., Foote, J., Golovchinsky, G., Uchihashi, S., and Wilcox, 
L., "A Semi-Automatic Approach to Home Video Editing," Proceedings of VIST '00, pp. 81-89, 2000. 




20. 


Lienhart, R., "Dynamic Video Summarization of Home Video," SPIE 3972: Storage and Retrieval for Media 
Databases 2000, pp. 378-389, 2000. 




21. 


Marchionini, G. and Geisler, G., "The Open Video Digital Library," D-Lib Magazine, Vol. 8, No. 12 
http://www.dlib. or^dlib/decembeK)2/marchionini/ 12marchionini.html, December 2002. 




22. 


Smith, J.M., Stotts, D. and Kum, S.-U., "An Orthogonal Taxonomy For Hyperlink Anchor Generation in 
Video Streams Using OvalTine," Proc. Of ACM Hypertext 2000, pp. 1 1-18, 2000. 




23. 


Sundaram, H. and Chang, S.-F., "Condensing Computable Scenes Using Visual Complexity and Film Syntax 
Analysis," Proceedings oflCME 2001, pp. 389-392, 2001. 




24. 


Uchihashi, S., Foote, J., Girgensohn, A. and Boreczky, J., "Video Manga: Generating Semantically 
Meaningful Video Summaries," Proceedings of ACM Multimedia '99, pp. 383-392. 




25. 


Boissiere, G., "Automatic creation of hypervideo news libraries for the World Wide Web," Hypertext '98 
Proceedings, ACM, Pittsburgh, PA, 1998. 






V<=»iino \A \A anH Vpn R _T "\7iHpo \ZiQim1 1*751 tirvn flrvr Pnmnart Prv^cf ntati c\v\ anH Vact RrnwQincy nf"* PiptntHnl 

X CLXllg, 1V1.1V1., <Xli\X X C- vf , U . 5 V lUV-v/ V loUullZjuXlVJIl IU1 V^-VJllllJClCL ritotllloUUll CLLlXl X uj I UlVJVVolIlg UI X l\, Uvyl Idl 

Content," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 7, No. 5, October 1997. 




A 1 . 


z^nang, ri.j., ei ai,, /vuiomanc .r arsing ana inuexing 01 i>ews viaeo, iviuuimeaia oysiems, z, \y), pp- zjd- 
266, 1995. 




28. 


Russell, D., "A Design Pattern-based Video Summarization Technique: Moving from Low-level Signals to 
High-level Structure," IEEE 33 rd Hawaii International Conference on System Sciences, Vol. 3, Maui, Hawaii, 
January 04 - 07, 2000. 




29. 


Wildemuth, B., et al., "How Fast Is Too Fast? Evaluating Fast Forward Surrogates for Digital Video," JCDL 
'03 May 1-2, 2003, Houston Texas. 


Examiner 


Date Considered 


♦EXAMINER: Initial if citation considered, whether or not citation is in conformance with MPEP 609. Draw line through citation if not in 
conformance and not considered. Include copy of this form with next communication to applicant. 


*1 = Copy not submitted because it was submitted in prior application SN / , filed , 20 , relied on under 35 USC §120. 
*2 - Copy not submitted because it was submitted in prior application SN / , filed , 20 , relied on under 35 USC §120. 
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